Quaternion-Valued Correlation Learning for Few-Shot Semantic Segmentation
نویسندگان
چکیده
Few-shot segmentation (FSS) aims to segment unseen classes given only a few annotated samples. Encouraging progress has been made for FSS by leveraging semantic features learned from base with sufficient training samples represent novel classes. The correlation-based methods lack the ability consider interaction of two subspace matching scores due inherent nature real-valued 2D convolutions. In this paper, we introduce quaternion perspective on correlation learning and propose Quaternion-valued Correlation Learning Network (QCLNet), aim alleviate computational burden high-dimensional tensor explore internal latent between query support images operations defined established algebra. Specifically, our QCLNet is formulated as hyper-complex valued network represents tensors in domain, which uses quaternion-valued convolution external relations when considering hidden relationship sub-dimension space. Extensive experiments PASCAL-5i COCO-20i datasets demonstrate that method outperforms existing state-of-the-art effectively. Our code available at https://github.com/zwzheng98/QCLNet
منابع مشابه
One-Shot Learning for Semantic Segmentation
Low-shot learning methods for image classification support learning from sparse data. We extend these techniques to support dense semantic image segmentation. Specifically, we train a network that, given a small set of annotated images, produces parameters for a Fully Convolutional Network (FCN). We use this FCN to perform dense pixel-level prediction on a test image for the new semantic class....
متن کاملFew-shot Learning
Though deep neural networks have shown great success in the large data domain, they generally perform poorly on few-shot learning tasks, where a classifier has to quickly generalize after seeing very few examples from each class. The general belief is that gradient-based optimization in high capacity classifiers requires many iterative steps over many examples to perform well. Here, we propose ...
متن کاملPrototypical Networks for Few-shot Learning
A recent approach to few-shot classification called matching networks has demonstrated the benefits of coupling metric learning with a training procedure that mimics test. This approach relies on an attention scheme that forms a distribution over all points in the support set, scaling poorly with its size. We propose a more streamlined approach, prototypical networks, that learns a metric space...
متن کاملBoosted Zero-Shot Learning with Semantic Correlation Regularization
We study zero-shot learning (ZSL) as a transfer learning problem, and focus on the two key aspects of ZSL, model effectiveness and model adaptation. For effective modeling, we adopt the boosting strategy to learn a zero-shot classifier from weak models to a strong model. For adaptable knowledge transfer, we devise a Semantic Correlation Regularization (SCR) approach to regularize the boosted mo...
متن کاملMeta-SGD: Learning to Learn Quickly for Few Shot Learning
Few-shot learning is challenging for learning algorithms that learn each task in isolation and from scratch. In contrast, meta-learning learns from many related tasks a meta-learner that can learn a new task more accurately and faster with fewer examples, where the choice of meta-learners is crucial. In this paper, we develop Meta-SGD, an SGD-like, easily trainable meta-learner that can initial...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Circuits and Systems for Video Technology
سال: 2023
ISSN: ['1051-8215', '1558-2205']
DOI: https://doi.org/10.1109/tcsvt.2022.3223150